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ABSTRACT 

To  enable  a  quantitative  approach  to  the  problems  of  control  and 
synthesis  of  multivariable  system  a  measure  of  interaction  strength  is 
proposed.  Measiire  is  defined  as  a  property  of  the  system  under  consider¬ 
ation  in  terms  of  the  tiro  conceptual  experiments.  Necessary  and  sufficient 
conditions  for  unit  interaction  are  given  for  different  types  of  linear 
systems,  A  statistical  approach  to  the  interaction  measure  is  also  dis¬ 
cussed. 
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MEASURE  OF  INTERACTION  IN  A  SYSTEM 
AND  ITS  APPLICATION  TO  CONTROL  PROBLEMS 

I.  Introduction 

Problems  of  analysis  and  synthesis  of  a  complex  and  multivariable  systems 
present  on  one  hand  a  special  challenge  to  the  science  today  in  many  different 
facets  and  on  the  other  hand  present  a  daily  problem  in  many** practical  engin¬ 
eering  situations;  a  problem  which  cannot  be  avoided  or  ignored  any  moreo  What 
is  necessary,  to  cope  with  this  situation,  is  a  consistent  approach  to  multi¬ 
variable  systems  which  will  take  into  accomt  the  very  specific  nature  of  such 
systems  o  This  viewpoint  was  discussed  in  detail  in^^^  irtiere  it  was  shown  that 
in  order  to  build  such  an  approach  it  is  necessary  to  attack  the  problems  of 
interactions  on  a  scientific,  ergo,  quantitative  basis.  This  paper  presents 
an  initial  atten^it  toward  developing  such  an  approach  to  the  problem  of  inter¬ 
action.  It  presents,  in  essence,  concretization  of  the  ideas  developed  in^^\ 

In  addition  to  the  discussion  of  the  basic  properties  of  interaction  such  as 
instances  of  unit  and  zero  interactions  a  possible  measure  of  the  interaction 
strength  is  proposed. 

It  is  interesting  to  review  briefly  how  the  problem  of  interaction  has 
been  treated  so  far  in  the  control  theory.  In  the  early  '•servomechanism"  age 
of  the  control  theory  the  trend  was  to  disregard  the  interactions  and  to  treat 
every  individual  input-output  pair  by  single  variable  techniques.  Attempts  to 
justify  this  assumption  in  practice  by  intentionally  decoupling  the  multivari¬ 
able  system  have  almost  never  been  successful.  In  the  later  "computer  control" 
ago  of  control  theory  a  trend  toward  the  other  extrenw  has  been  developed.  A 
complete  knowledge  of  the  process  is  assumed  and  the  computer  is  assumed  to 
generate  the  best  possible  manipulated  input  set  to  the  system  under  control© 
Using  state  variable  approach  multi-dimensional  and  multivariable  problems 
have  been  equated.  The  underlying  philosophy  was  that  the  computer  is  or  can 
be  made  to  be  almighty  and  therefore  can  answer  all  the  problems  no  matter  how 
complex  is  the  system.  It  was  not  long  before  the  pittfalls  of  such  an  approach 
were  recognized. 

In  the  present  state  of  knowledge  it  might  be  rather  safely  asstimed  that 
an  integrated,  centralized,  dynamically  optimal  computer  control  is  on  the  verge 


of  the  impossible  if  the  system  is  of  a  reasonable  size,  say  irith  twenty  state 
variables. 

To  cope  with  these  problems  a  novel  approach  to  control  of  complex  multi- 
variable  systems  has  been  suggested  termed  the  organizational  or  multi-level 

(2) 

goal-seeking  approach.  Highlights  of  this  approach  are:  reticulation  of 
the  system  into  the  subsystem  by  grouping  the  strongest  interacting  variables j 
control  every  one  of  the  subsystems  in  the  best  possible  fashion  using  inter- 
acting  control  approach  5  recompensating  for  the  overlooked  subsystems  inter¬ 
actions  by  the  coordinating  action  of  a  set  of  optimizers  or  controllers  arrang¬ 
ed  in  a  hierarchy  on  different  levels. 

To  in^jlement  such  an  approach  to  control  of  complex  systems  a  measure  of 
interaction  is  necessary.  It  is  within  the  immediate  framework  of  this  approach 
that  the  subsequent  development  of  the  interaction  measure  took  place. 

It  is  of  interest  to  notice  that  the  multi-level  goal-seeking  approach  is 
applied  in  many  conplex  natural  systems  such  as  in  the  coordinating  action  of 
the  central  nervous  system  or  in  man-made  systems  such  as  industrial  organiza- 
tiona^^\  One  would  expect,  therefore,  that  similar  principals  might  be  useful 
when  the  conplexity  of  the  technical  system  under  control  becomes  conparable  to 
the  complexity  of  the  mentioned  natural  systems. 

II.  Basic  Considerations  of  the  Interaction  Measure  Concept 

The  concept  of  interaction  introduced  in  this  paper  is  based  on  the 
following  considerations: 

1.  Interactions  are  viewed  in  a  behavioristic  fashion  on  the  basis  of 
the  mutual  influence  of  the  two  variables  or  two  sets  of  variables  regarding 
them  as  time  functions  and  disregarding  many  non-abstract  attributes  of  the 
system  such  as  energy,  spatial  and  temporal  closeness,  etc. 

2.  Interactions  under  consideration  in  this  paper  relate  output  variables. 

In  general  interactions  between  the  two  subsystems  can  be  approached 

in  two  ways: 

a)  "TUhite  box"  approach  -  when  one  has  access  to  the  system  and  can 
recognize  the  subsystems  and  measure  the  terminal  variables  of  the  subsystems 
which  are  the  inside  variables  of  the  system.  The  subsystem  interaction  is 
defined  in  terms  of  these  inside  variables. 
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b)  "Black  box"  approach  -  when  the  observer  does  not  have  the  access 
to  the  inside  of  the  systemo  Interaction  between  the  subsystems  should  be  con¬ 
cluded  upon  from  the  observation  of  the  system.  The  only  subsystems  which  can 
be  considered  are  those  for  which  at  least  a  subset  of  their  terminal  variables 
are  at  the  same  time  terminal  variables  of  the  system.  Two  further  distinctions 
can  be  made. 

a)  Cross-transfer  interactions  specify  the  relations  among  the 
sets  of  input  and  output  variables. 

P)  Output  interactions  specify  the  relation  among  the  subsets  of 
the  outputs  set. 

We  shall  consider  in  this  paper  p-category  of  interactions  i.e.  output 
interactions.  The  reasons  which  causes  the  emphasis  on  this  type  of  interaction 
are  the  following:  In  a  control  situation,  one  is  concerned  with  influencing 
the  behavior  ''f  the  output  variables  of  the  system  in  a  best  optimal  way  with 
the  specified  restrictions  and  constraints.  The  primary  task  in  facilitating 
a  multivariable  control  problem  by  reticulation  is  to  subdivide  the  set  of 
output  variables  into  the  subsets  which  will  be  influenced  optimally  (\mder 
constraints)  in  a  spacially  or  temporally  separated  arrangements.  Of  special 
concern  is  how  the  control  of  one  output  subset  i.e.  of  one  sub-system,  influ¬ 
ences  the  behavior  of  the  rest  of  the  system  ergo  the  remaining  output  subset. 

One  woxild  desire  to  group  all  the  strongly  interacting  outputs  into  given  groups 
and  define  the  subsystems  borders  along  the  lines  of  weak  outputs  interaction. 

3.  Interactions  are  considered  dynamically.  They  relate  the  time  fiinctions 
in  a  finite  or  infinite  time  intervals. 

We  are  now  in  a  position  to  define  the  black  box  output  interactions  as 
a  dynamical  property  of  an  abstract  or  physical  system.  In  order  for  a  system 
attribute  to  be  general  it  should  be  defined  on  the  basis  of  the  behavior  of 
systems  itself  therefore  on  the  basis  of  a  conceptual  "experiment"  rather  than 
on  the  basis  of  any  specific  analytical  description  of  the  system.  To  specify 
output  interaction  one  has  to  observe  the  systems  behavior  in  two  different 
modes,  therefore  to  perform  two  "experiments": 

a)  Observe  the  behavior  (make  the  record  of  the  time  fimctions)  of 
the  two  outputs  "i"  and  "j"  (two  output  sets)  over  the  time  interval  under 
consideration . 
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b)  Change  the  behavior  (time  function)  of  the  output  i  and  observe 
the  change  produced  in  the  output  j.  The  change  produced  now  in  output  j  will 
specify  interaction 

Several  remarks  arise  immediately: 

1,  Interaction  is  different  than 

2.  In  general)  especially  for  nonlinear  system,  interaction  depends  upon  the 
operating  conditions  i«e«  input  juid  output  sets  in  "experiment”  ct  and  also  upon 
the  change  in  output  i  -  in  experiment  P® 

3«  Since  outputs  by  definition  cannot  be  changed  directly,  change  of  the  out¬ 
put  i  -  has  to  be  produced  by  a  change  in  the  input  sets.  Interaction,  there¬ 
fore,  depends  upon  this  change  too® 

In  view  of  these  three  remarks  the  experiments  a  and  p  should  be  carried 
out  in  the  following  way: 

a)  Change  one  input  J  (one  input  set)  in  a  given  way  and  also  change 
simultaneously  all  remaining  inputs  in  such  a  way  that  all  the  outputs  except 
J-th  remain  tmchanged® 

Ayj  7^  0  :  Ayj^  =  0 

Ic  ^  «  «  oil 

k  7^  J  (1) 

This  modified  experiment  is  necessary  in  order  to  recognize  the  input 
(sei^  with  respect  to  which  the  interaction  is  measured® 

p)  Keep  the  j-th  input  (set)  unchanged  and  change  all  remaining  inputs 
so  as  to  produce  a  given  change  in  i-th  output  and  prevent  changes  in  any  out¬ 
put  (set)  other  than  i-  and  ^ 

A  Xj  =  0  s  A  7)^  0 

k  —  1, o  o  ©n 

k  7^  3,  i  (2) 

On  the  basis  of  the  proceeding  specification  of  the  conditions  for  the 
two  experiments  three  basic  properties  of  interaction  become  apparent® 

1®  Interaction  depends  upon  the  outputs  in  both  experiments  and  upon  the 
specified  input  x^ 
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V[  yj(t),  yj(t),  (3) 

2.  Interaction  ia  zero  if  change  in  the  i-th  output  (subset)  produce 
no  change  in  the  J-th  output  (si;bset). 

3»  Interaction  is  of  an  infinite  strength  -  termed  unit  interaction  (be¬ 
cause  of  the  normalization  introduced  later)  -  if  the  changes  in  i-th  and  j-th 
outputs  (subsets)  are  always  mutually  related  functionally  in  the  same  way  which 
relationship  cannot  be  changed  by  any  manipulation  of  the  inputs..  In  other 
words  some  of  the  outputs  completely  specifies  the  others  Independent  of  the 
actual  inputs  o  In  the  case  of  the  analytically  described  systems  one  should 
be  able  to  derive  from  the  systems  equations  a  relationship  of  the  form 

f  Cy(t)3  =  0  j  f  ^  f  Cx]  (li) 

in  which  input  set  does  not  appear  explicitly.  Note  that  the  relationship  f 
is  neither  linear  nor  static  and  can,  in  general,  be  a  functional  as  well  as 
a  function.  The  dynamic  characteristic  of  the  interaction  under  consideration 
becomes  apparent  here. 

Zero  interaction  can  be  easily  recognized  either  from  experiment  or  from 
the  systems  equations.  Cases  with  unit  interaction  however  presents  special 
theoretical  problems  since  the  relationship  (U)  is  not  specified  in  any  other 
way  but  solely  by  the  absence  of  all  the  inputs , 

In  the  following  sections  we  shall  give  some  theorems  regarding  \init 
interaction  in  linear  systems,  Althou^  theorems  in  Sec,  (IV)  include  theorems 
in  (III)  as  special  cases  we  shall  follow  inductive  procedure  to  facilitate  the 
understandings  of  the  impact  of  the  theorems. 


III,  Interactions  in  a  System  Subdivided  into  Two  Subsystems 


Consider  a  n-variable  system  with  the  input  set  x(t)  =|xj(t)^and  the 
output  set  y(t)  Assume  that  the  system  is  recognized  as  consisting 

of  two  subsystems  S^  and  Sg  with  the  terminal  variables  x  ^'(t)  =jx 


and  x^2)(t) 


-C  (1)/ 

j 

respectively. 


It  is  assumed  here  that  input  and  output  vectors  of  each  sub-system  are  of 
the  same  order* 
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Interactions  can  be  now  defined  between  the  two  subsystems  in  terms  of  the 
both  output  vectors. 

In  experiment  a)  one  is  given  an  input  vector  x^^^(t)  while  the  changes  of 

-(2) 

the  output  vector  of  the  second  subsystem  y'  '(t)  should  be  compensated  by  the 

-(2) 

action  of  the  input  vector  x'  ■'(t).  The  conditions  for  performing  experiment 
are  therefore 

x^^\t)  =  given  =  0  (5) 

Since  we  are  dealing  here  with  the  vector  compensation  the  problems  of 

-(2) 

existence  and  uniqueness  of  the  required  input  set  x^  '(t)  become  of  special 
importance^^^.  Since  the  primary  requirement  is  to  eliminate  any  change  irtiich 
might  occur  in  y'  'Ct)  there  exist  a  con^ensating  set  in  the  class  of  imbounded 
real  functions  if  the  system  is  linear.  Uniqueness,  however,  of  a  linear  multi- 
variable  system  compensation  depends  upon  the  internal  structure  of  the  system. 
To  make  the  outcome  of  the  experiment  a )  nonambiguous  one  should  specify  addi¬ 
tional  constraints  which  together  with  cond  it  ion  (5)  uniquely  specifies  the 

-(2) 

compensating  vector  x'  '(t)«  This  point  is  of  a  much  greater  importance  for 
the  three  way  subdivision  of  the  system  as  will  be  shown  in  the  next  section. 
Conditions  for  experiment  p)  are  now 

€ 

x^^^t)  =  0  y^^^(t)  =  given  (6) 

Problems  of  existence  now  become  prominent  even  for  the  linear  system.  If  some 

of  the  elements  of  the  output  vector  are  not  functionally  independent  due  to 

the  internal  structure  of  the  system  iinder  consideration,  one  cannot  satisfy 

-(2) 

condition  (6)  for  any  y'  'Ct)« 

In  what  follows  it  will  be  ass\imed  that  the  existance  problems  for  the 

-C2) 

subsystem  (Sg)  have  been  considered  in  selecting  y'  '(t)  and  also  that  addi¬ 
tional  constraints  have  been  specified  to  make  the  input  vector  unique. 

The  form  of  the  conditions  idiich  specify  unit  interaction  between  the 
subsystems  (S^)  and  (Sg)  depends  upon  the  way  in  which  the  systems  stnicture 
is  represented.  It  is  non-trivial  to  consider  each  of  the  representation 
separately  since  in  the  special  case  as  for  example  for  unit  interaction  it 
might  not  be  possible  to  transform  the  system  from  one  representation  to 
another . 


G 
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a)  In  stata  variabla  representation  system  is  described  now  by  the  follow¬ 
ing  vector  equation 

—  =  A2  +  Bx  (7) 

dt 

y  =  C  z 

where  A,  B  and  C  are  constant  matid-ces^  z  is  a  state  vector  y  is  the  output 
vector  and  x  is  the  input  vector.  To  simplify  discussion  we  will  assume  that 
the  state  variables  are  defined  as  derivatives  of  the  output  variables  so 
that  the  state  variable  vector  can  be  partitioned  in  the  following  way 


For  a  unit  interaction  in  the  system  the  following  theorem  holds 
Theorem  1:  A  necessary  condition  for  the  system  to  have  \init  interaction 
is  that  the  Jordan  canonical  form  of  matrix  B  has  a  zero-eigenvalue  of 

-  (2) 

multiplicity  not  smaller  than  the  snallest  order  among  the  state  vectors  Zg' 
and  that  the  Jordan  canonical  form  of  the  matrix  B  has  multiplicative  chain 
associated  with  this  eigenvalue  of  the  same  order. 

Proof:  Using  Jordan  canonical  form  for  B  eqC  7)  can  be  written  in  the  form 

T  F—  - 
|_dt 

where 

B  =  f"^  J  T  (10) 

Under  the  conditions  of  theorem  (l)  the  Jordan  matrix  J  is  of  the  form 


where  is  a  k-th  order  matrix  of  the  form 


J 

o 


0^  Oy  •  •  0 

0^  0  9  • •  0 


The  state  vector  can  now  be  partitioned  in  the  following  way 


Je_ 


where  z  is  state  vector  of  an  output  of  p-th  order.  s 

Using  the  partition  (13)  of  the  state  vector  z  one  can  write  for  Eq,  (9) 

pl  pi  P  P2  P 


I  -  I  -  1  - 

[_dt  "-P»l  *n-p  n-p,2  ’“n-pj 


J^Px  =  0 


Since  in  Eq(lli)  no  input  appears  the  theorem  is  proven.  Eq(lli)  also  gives  a 
relationship  f  which  specifies  the  dynamics  of  the  unit  interaction. 

Necessary  conditions  does  not  specify  whether  the  unit  interaction  in 
the  system  is  between  the  two  subsystems  or  among  the  variables  of  any  of  the 
subsystems.  This  is  specified  by  the  equation  (Hi)  i.e.  by  the  outputs  which 
appear  in  it  or  rather  by  the  structure  of  the  matrices  associated  with  this 
equation. 

P  -  Canonical  Representation 

The  system  is  represented  now  by  the  vector  equation 

q  *  y  =  P  *  J  (15) 

Trtiere  Q  and  P  are  linear  differential  operator  matrices 


Q  = 
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i 
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and  in  addition  Q  is  diagonal* 

Both  vectors  x  and  y  can  be  partitioned  in  terms  of  the  terminal  variables 
of  the  both  subsystems  _  _  _ 


*  y^^^  = 

P  *  x^^^ 

^11  *  X 

+  P  * 

^12  *  X 

Qg  *7^  = 

P  *  x^^^ 
^12  * 

+  P  * 

*^22  ^ 

(16) 


Unit  interaction  is  now  specified  by  the  following  theorems 

Theorem  2;  System  (l5)  has  a  unit  interaction  if  and  only  if  the  following 
condition  is  satisfied  for  any  real  valued  vector  function  u(t) 

[^U  *  ^22  -  ^12  *  ?2l]  *  =  0 


Proof:  Using  the  properties  of  the  linear  operators  the  proof  follows  easily 
from  Eq,  (16).  Applying  ^2®  equation  and  operator  P-[  p  on  the  second 

one  obtains 

P22  *  ^1  ♦7^(t)  =  P22  *  ^11  *  ■**  ^22  *  ^12  * 

_  _  _  _  _  (18) 

P12  *  Q2  *  “  ^12  *  ^21  *  ^12  *  ^22  * 


from  irtiere  one  obtains 

P22  *  *  y^^^(t)  -  P12  *  ^2  *  = 


(19) 


Therefore  condition  (1?)  is  sufficient.  Since  only  two  vector  variables  are 
involved  to  prove  that  condition  (I7)  is  necessary  it  is  enough  to  exhibit  the 
only  other  possible  combination 

P21  *  Qi  *  y^^\t)  -  p^^  *  Qg  *  y^^^(t)  = 


P21  *  Pi2^  *  x^^\t) 


(20) 
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Trilich  follows  easily  from  (18).  Since  the  linear  operators  can  exchange  the 
order  in  which  they  are  applied  the  theorem  is  proved.  ^ 

Condition  Cl?)  specifies  unit  interaction  between  the  two  subsystems  only. 
If  the  Tonit  interaction  inside  any  of  the  subsystems  i.e.  among  some  of  their 
tezmdnal  variables  this  appears  in  the  form  of  the  functional  dependence  among 
the  elements  of  the  output  vectors  of  the  given  subsystem.  This  in  turn  pro¬ 
voked  the  existence  and  uniqueness  problem  in  the  a)  and  p)  experiments  but 
does  not  influence  directly  condition  (l?).  Therefore  condition  Cl?)  really 
specified  only  tinit  interaction  between  the  subsystems. 

c.  V -Canonical  Representation 
the  Systems  vector  equation  is  now 


L*y  =  N*x  +R*y 


(21) 


where  L,  N  and  R  are  linear  differential  operator  matrices,  L  =  N  =  (n^); 
R  =  (tj^)  and  L  and  N  are  diagonal  while  R  is  off  diagonal  i.e.  r^j  =  0  for  all 

J  =  i. 

It  is  apparent  that  the  system  has  unit  interaction  if  and  only  if  one  of 
the  following  conditions  is  satisfied 

1)  A  [In]  *  u(t)  =  0  (22) 


for  any  real  function  u(t)  i.e.  if  any  of  the  diagonal  elements  of  the 
matrix  N  is  zero. 

2)  If  I  I  - 00  (  23) 

for  one  or  more  J-s. 


IV,  Interactions  in  a  System  Subdivided  into  Three  Subsystems 

If  the  system  is  subdivided  into  three  subsystems  S^^  and  S^  one  can 
distinguish  two  situations  with  respect  to  interactions. 

A)  One  can  consider  interactions  between  one  subsystem  say  S^  and  the 
other  two  subsystems  and  S^.  The  problem  is  then  I’educed  to  the  one  discuss¬ 
ed  in  Section  III. 

B)  One  cam  consider  interactions  between  the  two  subsystems  say  and 
Sg  which  together  with  the  subsystem  conposed  the  system.  This  interaction 
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yrill  be  termed  relative  interaction.  The  problem  is  now  conceptually  different 
from  that  discussed  in  Section  III,  Interaction  is  considered  between  the  two 
parts  of  the  system  and  Sg  in  the  presence  of  another  subsystem  S^,  This 
presence  conditioned  interaction  ^2)(3)  ^  direct  influence  of  the  subsystems 

should  be  eliminated.  This  can  be  done  by  securing  as  the  primary  require¬ 
ment  in  the  consideration  _ 

y^3)(t)  =  0  (2U) 


To  achieve  this  as  well  as  to  secure  other  requirements  of  the  experiments 

“TTT 

input  vector  x  *^  should  be  used  so  that  in  general 

l?^(t)  0  (25) 

Conditions  for  experiments  a  and  P  regarding  subsystems  and  Sg  are  as 
before  Eq  (5)  and  (6).  Additional  requirements  (2U)  and  (25)  however  caused 
quite  different  behavior  of  the  system  as  it  will  become  evident  from  the 
following  discussion. 

a)  State  variable  representation 

Conditions  for  relative  unit  interaction  are  similar  to  the  ones 
stated  in  Theorem  1,  If  the  Jordan  canonical  form  of  the  matrix  B  is  of  the 
required  fora  EJq,  (9)  indicates  that  there  is  a  unit  relative  interaction  in 
the  system.  If  in  addition  does  not  appear  in  Eq.  (9)  and  the  homogeneous 

differential  equation  in  y  ^  and  has  non-trivial  solutions  tinit  relative 

interaction  exists  among  some  of  the  elements  of  the  vectors  y^^^  and 

b)  P-Canonical  Representation 

This  representation  is  very  suitable  to  indicate  the  basic  diff¬ 
erences  regarding  relative  interactions  between  the  two  subsystems  in  the 
presence  or  in  the  absence  of  another  subsystem  S^, 

The  systems  vector  equation  can  now  be  partitioned  in  the  following  way; 


(1)  +  p  *  (2)  ^  p  ^  (3) 


Q  *  V^^^  =  P  <■  ir^ 

''*2  J  ■*  21 


(l)  +  p  *  Y 
22  * 


^23  * 


*y^^^=  P- 


w  „(  l)  +  P  ^  „(  2  )  A  P  ^ 

X  ^  *32  *  ^  ^33  ^ 


Conditions  for  relative  unit  interaction  can  be  now  specified  by  the 
following  theorem 
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0 


Lemma:  1«  If  the  following  condition  is  satisfied  for  every  real  function  u(t) 

I  ^3  *  *'l2  -  'l3  *  ^2  1  *  '  0 


the  relative  interaction  between  the  system  and  Sg,  is  zero, 

2,  If  the  following  condition  is  satisfied  for  every  real  function  u(t) 


P  *  P  -  P  *  P 

33  22  13  32 


*  u(t)  =  0 


(26) 


the  relative  interaction  between  the  subsystems  and  Sg  is  undeterminable  by 
the  experiments  a  and  p « 

Theorem:  A  system  subdivided  into  three  subsystems  has  a  unit  relative  inter¬ 
action  among  the  subsystems  and  Sg  if  and  only  if:  l)  the  following  con¬ 
dition  is  satisfied  for  every  real  time  function  u(t). 

1  P  I  *  u(t)  =  0  (27) 

where  |P|  is  determinant  of  the  operators  from  Eq(2l4J^  2)  if  the  system  does  not 
have  zero  relative  interaction  specified  by  the  lemma  1  or  indeterminate  rela¬ 
tive  interaction  specified  by  lemma  2, 

Proof:  Consider  at  first  experiment  a,  Dk  ocnditicns  for  the  experiment  are 


*  7'^’ 

=  P  *  x^^^ 

-  ^21  *  * 

*^22* 

X  rg^ 

a  *  v^3) 

3  ^ 

—  P  * 

-  X 

*^2* 

„(2)  ^  p 

X 

*  x^^^  =  0 


*  =  0 


(28) 


Using  multiplicative  properties  of  linear  operators  one  obtains  from 
(2h)  and  (28) 


[ 


**22  *  ^33  “  ^23  *  **32 


a 


*  Q 


*  "y^  =  |P|  * 


(29) 


From  the  ri^t  side  of  Eq  (29)  one  can  conclude  that  condition  1  of  the 
theorem  is  sufficient.  From  the  left  side  one  cam  conclude  that  the  condition 
of  the  lemma  1,  causes  undeterminamcy  in  the  outcome  of  the  experiment  a). 
Conditions  for  the  experiment  P)  give  the  equations 
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7^  =  fjj* 

7^ 

X 

*  ^33 

*  "7^  =  0 

«1* 

75) 

**■  ^13 

*  x^^^ 

(30) 

^2* 

y'"'  =  ^22* 

75) 

*  ^23 

*7^ 

By  elimination  one  can  obtain  from  these 


(1)  .  rs 


P  *  * 

33  ^2 


L 

[ 


^33  *  ^12  "  **32  *  ^13 


P  #  P 
*^33  22 


^  P  #  P 

*^32  ^23 


] 

] 


*  X 


(2) 


(31) 


■7^ 

X 


From  Eq  (3I)  follows  that  the  =0 


under  the  condition  of  the  lemma 

(2) 

regardless  of  the  y  so  that  the  relative  interaction  between  and  Sg  is 
zero.  Since  Eq3.  (29)  and  (31)  give  complete  information  about  the  outcome  of 
the  both  experiments  the  condition  1  of  the  theorem  is  also  necessary  for  unit 
relative  interaction. 

It  is  interesting  to  note  that  lemma  1  specifies  a  zero  relative  inter¬ 
action  between  the  subsystems  S,  and  S„  only  because  of  the  primary  require- 
ments  that  =  0,  Really  from  Eq,  (3I)  one  obtains 


(2)  _  - 

y  -  X 


,(3) 


(32) 


where  V  and  W  are  linear  matrix  operators.  Eq.  (32)  shows  that  the  relative 
interaction  among  and  S^  is  a  vinit  one.  Therefore  zero  relative  interaction 
between  and  S2  indicates  only  that  a  much  stronger  interaction  exists  be¬ 
tween  and  (infinite  interaction).  Actually  if  the  interaction  between 
on  one  side  and  S^,  on  the  other  is  considered  (Case  A)  this  interaction 
is  not  necessarily  unit  one  in  spite  of  the  condition  (2^). 

C)  V -Canonical  Representation 
Equations  for  the  system  are  now 

\  *  y^^^  =  +  R^g  *  +  \3  *  y^^^ 


(33) 


(33) 


Lg  * 

7^  =  Ng* 

^(2)  4  J  +  R  * 

X  T  *  y  ^  «23 

737 

S* 

y(3)  =  * 

+  R^^  *  y^l>  +  R32  * 

Experiment  p  results  for  the  relation 


nhile  experiment  p  gives 


I<T  *  y 


m  =  5  .  /2) 
12  ^ 


It  is  apparent  that  condition  for  unit  interaction  is  again 


A  I  I  =0  or  II  R 


12 


00 


(3U) 

(3?) 


(36) 


V,  A  Measure  of  Interaction 

Consideraticns  in  the  preceeding  sections  enables  characterization  of  zero 
and  unit  interaction  in  a  system.  The  main  problem  left,  however,  is  how  to 
characterize  interactions  in  the  cases  other  than  zero  and  unit.  The  emswer 
to  this  question  is  very  difficult.  To  characterize  these  cases  it  is  necess¬ 
ary  to  introduce  a  measure  of  interaction  irtiich  Trill  serve  as  a  basis  for  com¬ 
parison  of  the  two  interactions  of  the  same  system  or  to  compare  different 
systems  regarding  the  interaction. 

Before  proposing  a  measure  of  interaction  consider  the  intuitive  require¬ 
ments  which  such  a  raeasTore  should  satisfy: 

1.  It  should  be  a  functional  defined  in  the  set  of  the  terminal 
variables. 

2.  It  should  be  equal  to  zero  if  and  only  if  the  interaction  is  zero. 

3.  It  should  be  equal  to  one  if  and  only  if  the  system  has  an  unit  inter¬ 
action. 

U.  It  should  bo  a  single-valued  function  of  the  systems  parameters  or 
characteristic  fvinctions  with  the  domain  between  zero  and  one. 


It  should  be  monotone  between  any  consecutive  intersections  with  the  lines 
amd  =  1. 


A  measure  of  interaction  can  bo  obtained  in  the  following  way. 

Define  a  functional  of  the  output  time  function  <j)  ^y^^  which  satisfies 
requirements  1.-5.  except  that  the  domain  of  the  functional  is  from  zero  to 
infinity.  Take  the  ratio  of  the  two  functionals  obtained  from  the  experiments 

P  A  r  -1 

.  *  [yJ 


Ji 


♦  [vj] 


(37) 


The  interaction  measure  is  now 


K 


*11 


1  +  K 


Ji 


(38) 


It  is  apparent  that  the  interaction  measure  as  defined  in  (37)  is  not 
unique.  It  depends  on  the  selection  of  the  functional  <1)  which  in  turn  should 
reflect  the  context  in  which  the  measure  is  used  and  also  should  bo  as  simple 
as  possible.  It  depends  also  on  the  test  signal  used.  The  importance  of  the 
iraput  amplitudes,  however,  can  be  eliminated  if  the  following  limit  exists 


lim  K 


Ji 


lim 

Xj-^ 


<1> 

♦  [vi 

(39) 


In  the  case  of  the  vector  subsystems  interaction  measure  (37)  becomes 


^(J)(i)  “ 


Z 

e=l 


(ho) 


For  a  linear  system  a  single  mean  square  fxinctional  may  be  appropriate 

<t>  llAy3  =Jt  irAy(t)3^ 


dt 


(Ul) 
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Trtiere  T  is  time  interval  in  which  the  systems  behavior  is  mder  consideration. 

For  a  final  value  system  functional  might  be  defined  in  terms  of  deviation 
of  the  final  state 

<1»=  CAy(T)]2  (^2) 


For  a  linear  system  and  V-canonical  representation  one  obtains 


(U3) 


j’  ["3  ]' 


dt 


Assume  the  following  selection  for  the  tost  change  y^^Ct)  is  made 
y^^Ct)  =  4 

Since  limit  (39)  now  exists 


V  -  li™ 
Ji  aA— ►0. 


it' 


“31 


(t)]' 


dt 


llfji 


*  * 

*  A  2jCt)J^ 


dt 


dt 


(U5) 


measure  is  independent  of  the  inputs  amplitudes. 

It  is  interesting  to  note  that  the  measure  is  defined  very  simply  in  terms 
of  the  V-canonical  representation.  This  seems  to  be  true  even  for  the  nonlinear 
systems.  Therefore  V-canonical  representation  appears  to  be  most  appropriate. 


VI.  A  Statistical  Approach  to  the  Interaction  Measiure 


A  meas\iro  of  interaction  as  defined  in  (37)  depends  upon  the  form  and  in 
general  even  upon  the  amplitudes  of  the  input  vector.  This  pittfall  can  be  re¬ 
duced  if  the  meas\ire  is  defined  statistically  on  a  whole  set  of  input  vectors. 
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Assuming  that  the  set  is  finite  one  obtains  for  the  measure 


“tl  ’  ‘‘il} 

’  '’il} 


(U6) 


T^ere  U  Indicates  operation  of  mathematical  expectation  and  p  Is  the  dimension 
of  the  set.  If  the  set  is  infinite  and  can  be  specified  with  a  parameter  X 
one  obtains 


dx} 


Consider  several  examples  of  the  input  sets.  Assvune  that  the  input  set 
is  a  real  vector  soace  generated  by  a  basis  jzj^(t),  ...  Interaction 
meas\are  becomes  now 


>  ■>>  ■*‘1} 

Kji  -  (1,8) 

y  Ct  ,  Q)  «  } 


If  the  vector  space  (7„  is  of  infinite  dimensions 


x(t)  =  J*  V(s)  z(s,  t)ds 


interaction  measures  become 


.  ^  y^(t  ,  s)  dt 
“ft  J  ^ 


ds 


'll  o  yj(t  ,  s)  dt  M  j> 


(U9) 


ds 


Preceeding  discussion  indicates  the  structure  of  the  proposed  measure  of 
interaction.  Many  problems  of  the  application  of  this  measure,  however,  are 
outside  of  the  scope  of  this  paper. 
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VII,  Behavior  of  the  System  in  the  Constrained  Environment  - 
Cohesion  of  the  Syatema 

Interaction  is  considered  to  be  the  property  of  a  system  which  should  be 
as  much  as  possible  independent  of  the  circumstances  in  which  the  system  oper¬ 
ates.  If  the  behavior  of  the  system  is  restricted,  however,  this  has  to  show 
up  in  the  measure  of  interaction  and  in  fact  in  analytical  or  experimental 
determination  of  the  measure.  To  take  into  account  these  restrictions  the  concept 
of  cohesion  has  been  introduced.  Its  definition  is  based  on  the  following: 
Consider  a  system  with  the  given  constraints  reflecting  physical  realization 
or  economical  optimum.  There  is  a  given  set  of  output  vectors  which  now  can 
be  achieved  without  any  deviation  or  error  by  acting  on  the  system  with  a  set 
of  inputs  from  the  given  restidcted  class.  With  respect  to  these  outputs  the 
system  will  be  defined  to  have  zero  cohesion.  Outputs  outside  the  class  of 
zero  cohesion  can  be  achieved  by  the  given  system  only  approximately.  The 
success  in  the  achieving  these  outputs  define  cohesion  of  the  system  in  the 
given  constrained  conditions.  It  is  interesting  to  note  that  if  the  desired 
outputs  behavior  is  specified  only  by  a  point  in  the  state -variable  hyperspace 
independent  of  the  time  when  this  point  is  reached  one  has  a  special  problem  in 
cohesion  which  \inder  the  name  of  contro lability  has  been  studied  by  several 
authors . 


vm.  Application  of  the  Interaction  Measure  in  Control 

Measure  of  interaction  should  become  standard  concept  in  the  analysis  and 
synthesis  of  the  large  control  system.  Ihe  areas  of  its  application  mi^t  be  divid¬ 
ed  into  three  parts. 

1.  In  analyzing  large  complex  systems  one  should  establish  matrix  of 
relative  output  Interaction  K  which  will  serve  as  a  basis  for  determin¬ 

ing  which  approach  will  be  taken  in  solving  control  problems.  For  example,  the 
interaction  matrix  will  indicate  idiether  some  of  the  subsystems  can  be  treated 
independently  and  also  whether  interactions  inside  a  given  subsystem  are  strong 
or  weak.  For  a  strongly  interacting  system  a  centralized  control  can  be  applied 
while  for  the  weakly  interacting  systems  cross-controller  approach  might  be  more 
appropriate . 
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2.  Interaction  measxire  offers  a  method  for  realization  of  organizational 
approach  discussed  in  the  Introduction.  The  system  can  now  be  subdivided  into 
more  subsystems  than  in  case  1  since  the  introduction  among  the  subsystems  will 
be  taken  care  of  by  the  controllers  on  the  higher  level. 

3.  Interaction  in  a  system  can  be  evaluated  continuously  and  used  in  an 
adaptive  interacting  control  approach. 

IX.  Conclusions 

The  present  paper  offers  a  conceptual  basis  for  a  quantitative  approach 
to  the  problem  of  interaction  and  also  gives  an  analytical  basis  as  to  how 
the  problem  can  be  solved  for  linear  systems.  The  proposed  approach  however 
opens  a  vast  area  of  problems,  some  of  them  as  e.g.  those  connected  with  non¬ 
linear  systems  are  of  great  complexity.  The  problems  which  need  immediate 
fiirther  study,  however,  are  these  connected  with  the  application  of  the  ap¬ 
proach.  In  this  respect  it  is  of  particular  significance  that  the  measvire 
of  interaction  is  defined  for  '’black  box”  systems,  and,  therefore,  the  asso¬ 
ciated  problems  can  be  studied  without  use  of  involved  analytical  apparatus 
but  rather  by  using  a  conputer  or  experiments  on  actual  systems. 
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